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Abstract 

In singlet extensions of the two Higgs doublet model, a light CP-odd Higgs boson {A) can 
significantly modify decay modes of the charged Higgs, without necessarily affecting decay modes 
of the standard model-like Higgs boson. These effects can be sizable even if the doublet component 
of the light CP-odd Higgs is small, so that constraints from Upsilon decays and direct CP-odd 
Higgs production do not apply. We study a scenario in which the charged Higgs is produced in 
top quark decays, t — )• H^b, with dominant — )• W^A. We focus on the CP-odd Higgs mass 
range below the bb threshold. We summarize all current experimental constraints and find that, 
as a result of — t- W^A dominance, this scenario is not constrained in a large region of tan /3, 
mjj±, and CP-odd Higgs doublet component. We discuss search strategies based on A —)• r+r", 
with both taus decaying leptonically, and on the subleading decay mode A — )• /i^/U^. We show 
that a search for t — )• H^b, — )• W^A, A — )• iJi~ in 20 fb^^ of 8 TeV LHC data can constrain 
most of the currently allowed parameter space. Existing trilepton searches are not sensitive to this 
signal due to the adopted isolation criteria. 
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I. INTRODUCTION 



The exciting discovery of a new particle at the LHC [H |2] raises many questions and 
creates new challenges. Although current data indicate that the particle has properties 
close to what is expected from the Higgs boson in the standard model (SM), much larger 
data sets will be needed to determine whether it really is the Higgs boson that completes 
the standard model or a particle that points to a new physics. A significant deviation in 
production cross sections or branching ratios in various channels from those predicted by 
the SM can be observed at any point. In addition, this particle could be accompanied by 
more Higgs states. 

In well motivated theories beyond the SM the Higgs sector is typically more complicated. 
Models with two Higgs doublets, for example the minimal supersymmetric model (MSSM), 
contain five Higgs bosons in the spectrum: light and heavy CP-even Higgses, h and H, the 
CP-odd Higgs, A, and a pair of charged Higgs bosons, H^. Singlet extensions of the two 
Higgs doublet models, for example the next-to-minimal supersymmetric model (NMSSM), 
contain three CP-even Higgs bosons, two CP-odd Higgs bosons, and a pair of charged Higgs 
bosons, and there are many simple models with even more complicated Higgs sectors. It 
is usually the case that there is one Higgs boson with properties (couplings to W and Z 
bosons) of the SM Higgs, we refer to it as the SM-like Higgs. However, such a Higgs does 
not necessarily decay in the same way as the SM Higgs, and a significant model dependence 
of decay modes applies to other Higgses as well. 

It is well known that the presence of a light CP-odd Higgs boson can modify the de- 
cay modes of heavier Higgses. We study a scenario with the charged Higgs lighter than 
the top quark, so that t — )■ H^h decay mode is present, and a light CP-odd Higgs so that 
— )■ W^A decay mode is open and can dominate. This scenario generically appears and 
is phenomenologically viable in singlet extensions of the two Higgs doublet model with or 
without supersymmetry [3H5]. In order for our study to be applicable to a variety of mod- 
els we only assume couplings of Higgs bosons originating from doublets to fermions, gauge 
bosons, and other Higgses according to the two Higgs doublet model Type II (supersym- 
metric models are of this type). The two CP-odd Higgses originating from doublets and 
the singlet can mix, and thus the light CP-odd Higgs is allowed to have an arbitrary dou- 
blet fraction. We do not assume any specific mass relations in Higgs spectrum, and we do 
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not include any kind of corrections originating from additional particles in specific models, 
such as SUSY corrections. We summarize experimental constraints from direct searches for 
— )■ TV, — )■ cs, and — )■ W^A followed by A — t- t^t^ , and show that, as a result 
of — )■ W^A dominance, this scenario is not constrained in a large range of tan (3, mH±, 
and the doublet fraction of the CP-odd Higgs. We do not impose any constraint from flavor 
changing rare decays (e.g. B — )■ Xs7, Bg /i'^At", etc.) as they may strongly depend on 
other sectors of a complete model. 

A light CP-odd Higgs can simultaneously modify decay modes of other Higgses. This 
has been extensively studied in the context of possible modifications of decay modes of 
the SM-like Higgs boson {h — )■ AA can be the dominant decay mode), see for instance 
Refs. [EHO], motivated by considerations of naturalness of electroweak symmetry breaking 
in supersymmetric models [lOj. Current data do not favor non-standard dominant decay 
modes of the SM-like Higgs. However, we show that — )■ W^A can be the dominant 
decay mode of the charged Higgs boson even if the CP-odd Higgs has only a tiny doublet 
component so that it is not constrained by direct searches, Upsilon decays, and it would not 
significantly affect the decay modes of the SM-like CP-even Higgs boson. As an example, 
we discuss the viability of this scenario in the NMSSM. 

The existence of a light CP-odd Higgs boson can be motivated by approximate global 
symmetries and thus it occurs in a variety of models. Examples include the NMSSM with 
R-symmetry or Peccei-Quinn symmetry [TTl |T2], models with new strong dynamics [TH] . 
little Higgs models [HIIS], and models with hidden sectors [TB] . 

In this paper we discuss search strategies for the charged Higgs boson appearing in top 
quark decays, t — > H^b, — )• W^A with either A — > fi^fi^ or A t^t^ (with both rs 
decaying into leptons). This is especially advantageous if the CP-odd Higgs is below the 
bb threshold, that is the scenario we investigate, but is also applicable to heavier CP-odd 
Higgses. The outline of the strategy and some preliminary results were given in Ref. [IZj.* To 
suppress background, especially from semileptonic bottom and charm decays, we require an 
additional lepton (e or /i) from one of the two Ws. In addition to the case when A — > fi^fi'~, 
in which the mass of the CP-odd Higgs can be reconstructed, there is a complementary 

* A complementary search strategy for t -> H'^b, H"^ A with the CP-odd Higgs boson above the 6& 

threshold was recently discussed in Ref. [T5] . 
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signal in which the e and /i leptons originate from A — )■ t~^t~. The latter can also be 
observed especially for trilepton combinations with two same sign and same flavor leptons, 
e.g. fi^^'^e^ , which have very low background. We show that these searches in 20 fb~^ of 
data from the 8 TeV run of the LHC can constrain a large region of the parameter space to 
which other searches are not sensitive. In particular, we show that existing trilepton searches 
are not sensitive to this signal due to the adopted isolation criteria. We also discuss the 
reach of the LHC at 14 TeV center-of-mass energy. Additional improvements of the analysis 
are possible with b-tagging that we do not require here. 

The decay mode — )■ W^A that we are studying in singlet extensions of the 2HDM, has 
been investigated in the MSSM [191 EO]^, in a variety of scenarios with two or more Higgs 
doublets [221 ES], and scenarios beyond the MSSM that can be parameterized by certain 
higher dimensional operators [211 |25]. A light charge Higgs scenario was also discussed 
in connection with the 2.8a deviation from lepton universality in W decays measured at 
LEP [2n], to which a charged Higgs with mass close to the mass of the W boson can 
contribute [23, [2H], and if^ — )• W^A decay mode can provide a viable option to avoid LEP 
hmits [28] . 

This paper is organized as follows. In Section [TT] we discuss properties of the charged and 
CP-odd Higgs bosons in singlet extensions of the two Higgs doublet model Type II (as an 
example we discuss this scenario in the NMSSM), and describe the region of the parameter 
space in which — )■ W^A dominates. We discuss constraints from direct production of 
the CP-odd Higgs, Upsilon decays and also from the requirement that the decay modes of 



the SM-like Higgs boson are not significantly modified. In Section |III| we present numerical 
study of if: — )■ H^h, — )■ W^A, explore the parameter space of the model, and summarize 
experimental constraints from direct searches for — )■ rz/, — > cs, and — )■ W^A 
followed by A — r^r^ . The LHC study of search strategies based on leptonic decays of rs 
from A —7- r+r^, and a subleading decay mode of the CP-odd Higgs, A — )■ is presented 



in Section IV We also discuss relevant background in detail, and discuss the reach of the 



LHC at 8 TeV and 14 TeV in this Section. We conclude and discuss possible improvements 



^ In the MSSM — > W^A is typically not the dominant decay mode since in most of the parameter 
space it is not kinematically open as a two body decay. It can be the dominant decay mode of the 
charged Higgs only for a sufficiently light CP-odd Higgs [H], [3]. However, such a scenario is no longer 
phenomenologically viable in the MSSM. 
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of the analysis in Section |V} Formulas for decay widths are summarized in the Appendix. 



II. LIGHT CHARGED HIGGS BOSON WITH DOMINANT W^A 

Couplings of the charged Higgs to quarks and leptons can be written as: 

C D [uiVij {mdjXPji + muYPi) dj + Vim^^ZPRe^] + h.c. (1) 

where i,j are flavor indices and V is the CKM matrix. In general, coefficients X, Y, Z 
can be arbitrary complex numbers. However, in the two Higgs doublet model (2HDM) of 
Type II and supersymmetric models (that we will focus on), X = Y = 1/Z = tan /3, where 
tan P is the ratio of vacuum expectation values of the two Higgs doublets. In these models, 
if the charged Higgs is lighter than the top quark, the dominant decay modes of the charged 
Higgs are: — )■ cs for small tan P and — )■ tu for large tan /3. 

In presence of a light CP-odd Higgs boson A, another decay mode, — )■ W^A, can 
easily dominate. This is because the strength of the — — A interaction is given by 
the gauge coupling g2 of SU (2) which is much larger than Yukawa couplings of the charm 
and strange quarks and of the tau lepton that control the decays modes to fermions. In 
models with more than one CP-odd Higgs boson, e.g. in singlet extensions of the two Higgs 
doublet model, the — — A coupling is proportional to the doublet component of the 
corresponding mass eigenstate: 

A = cos 9a A2HDM + sin 9a As. (2) 

The partial width of the Charged Higgs boson decaying into tau lepton and neutrino is 
given by (neglecting the mass of the tau) 

T{H^ Tu) ~ ^^mltan'/3, (3) 

while the partial width of the Charged Higgs boson decaying into W boson and the CP-odd 
Higgs, when kinematically possible, is given by (neglecting the mass of the CP-odd Higgs): 

r(..*.«-.).|^|.(i-^)\o.^... (4) 

where cos 9a is the doublet component of the CP-odd Higgs mass eigenstate (at the ampli- 
tude level). Thus the — )■ W^A decay mode dominates for: 

2m^ 

cos^ 9a > ^ tan^ j3. (5) 



This equation receives corrections proportional to m\^/rn?^^ that can be derived from the 
exact formulae presented in the appendix. 

For medium or large tan /3 the — )■ W^A mode is sizable only if the CP-odd Higgs has 
a significant doublet component; however as tan /3 approaches 1, — )■ W^A dominates 
even if the CP-odd Higgs has only (9(1%) doublet component (i.e. cos^6'a ~ 0.01). For 
tan/3 ~ 1 also the — )■ cs decay becomes relevant; this, however, does not change our 
conclusions. The minimum of the doublet component of the CP-odd Higgs (cos^ 9 a) required 



for — )■ W^A to dominate is plotted in Fig. |4]as a function of Mh± and tan {3 (see Sec. HI 
for a detailed discussion). 

In the scenario that we consider in the following sections, the couplings of Higgs doublets 
to gauge bosons and fermions are identical to those in the Two Higgs Doublet Model Type 
II, and the lightest CP-odd Higgs mass eigenstate can have an arbitrary doublet component. 
We do not consider corrections to Higgs couplings and masses that occur in specific models, 
e.g. in supersymmetric models. By minimizing the model dependence of our study, all the 
results we obtain can be easily reinterpreted in a variety of models. Nevertheless, in order 
to further motivate this scenario we demonstrate, in the following subsection, that it is also 
viable in supersymmetric models in which the Higgs sector is more constrained. 



A. Light charged and CP-odd Higgs bosons in the NMSSM 

The scenario we discussed in the previous section occurs and is phenomenologically vi- 
able in the simplest extension of the MSSM, the next-to-minimal supersymmetric model 
(NMSSM), which adds only one singlet chiral superfield, S. Its particle content differs from 
the MSSM by the addition of one CP-even and one CP-odd state in the neutral Higgs sector 
(assuming CP conservation), and one additional neutralino. Apart from the usual quark 
and lepton Yukawa couplings, the scale invariant superpotential 

A SHuHd (6) 

depends on two dimensionless couplings A and k beyond the MSSM. The associated soft 
SUSY breaking trilinear terms are 

A AxSHuHd + '^A^S^ (7) 
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(hatted letters denote superfields, while unhatted correspond to their scalar components). 
The Higgs sector of the NMSSM is described by these trilinear and soft trilinear couplings, 
together with two further input parameters, tan/3 = v^/vd and /Xeff = As, where f„ = {Hu)i 
Vd = {Hd) and s = {S). 

The scenario that we consider hinges on several properties of the lightest CP-odd Higgs. 
First of all, we need a CP-odd Higgs lighter than ~ 10 GeV so that it dominantly decays 
into r+r^. This can be achieved by approximate global symmetries; for instance, in the 
U{1)r symmetry limit of the NMSSM, A^^Ax — )■ 0, the CP-odd Higgs is exactly massless 
(for more details and formulas, see e.g. Ref. [12] )• The second important property is the 
strength of its couplings to other Higgses, gauge bosons and fermions. This is controlled by 
the doublet component of the lightest CP-odd Higgs mass eigenstate, cos^ Oa'- 

A = cos 9a Amssm + sin 9a As. (8) 

For example, in the limit A^, Ax ^ we find cos9a — (v/s) sin 2/3. 

The discussion of decay modes of the charged Higgs is basically identical to our general 
discussion, namely formulas for partial decay widths of the charged Higgs given in Eq. ^ 
and Eq. ^ are only slightly modified by SUSY corrections. However, a light CP-odd Higgs 
can also significantly modify the decay modes of the SM-like Higgs which is not favored by 
current data. In what follows we show that in the NMSSM the decay mode — )■ W^A 
can dominate while the decay modes of the SM-like Higgs are not significantly modified. 

The partial width of the lightest doublet-like CP-even Higgs boson decaying into bb is 
given by (neglecting phase space suppression): 

Q 2 / \ 2 

( cos a ^ 



while its partial width into two CP-odd Higgs bosons, when kinematically allowed, is given 
by (neglecting phase space suppression) ^12] : 



T{h AA) 



2 

W 



3271 g^Mh [ 2 



_j_ „2 

^ ^ COS 2(3 sm{(3 + a) cos^ 9a + /(A^ \k, k^, \Ax, kA^) 



2 



(10) 

The first term corresponds to the two Higgs doublet contribution and is the only term 
that survives in the cos^ 9a = ^ limit. The second piece represents terms originating from 
couplings of the singlet. Their exact form can be found in Ref. [I2]. In the limit a — ?■ /3 — 7r/2 
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the lightest doublet-hke CP-even Higgs boson has couphngs to gauge bosons and fermion 
as the SM Higgs boson. In this case cosa/ cos/3 — t- tan/3, sin(/3 + a) — t- —cos 2/3, and 



considering, for the time being, only the first term in Eq. (10) we find: 

2 

(11) 



T{h->bb) f 2V3g^ MhTJib tan (3 1 



T{h^AA) \gl + gi cos2 2/3 cos2 
For any 1 < tan /3 < 50 we find tan/3/ cos^ 2/3 > 5 with the minimum at tan /3 ~ 3. Thus, 



considering only the first term in Eq. (10), the h — )■ AA mode dominates only if the CP-odd 
Higgs has a significant doublet component, cos^ 6*^ > 0.5. 



The second piece in Eq. (10) depends strongly on the choice of parameters: it can be 
very small, or it can easily make h — )■ AA to dominate for any tan /3 even for very singlet- 
like CP-odd Higgs boson. This was investigated in detail in Ref. [12] where the conditions 
under which h — )■ AA dominates were studied. It was found that a non-zero soft trilinear 
couplings, especially Ax, was crucial. For example, in the limit Ax,Ai^ — 0, the branching 
ratio h — )■ AA is at most of order 10% while cos^^ ^ (f/s)sin2/3. This is an example 
of the parameter space in which the doublet component of the CP-odd Higgs can be large 
enough for W^A to dominate while B{h — t- AA) is small. Indeed, in the numerical 

study, scenarios with negligible B{h ^ AA) and cos^ 6'a — 0.1 appeared, see Fig. 12 in [12]. 
Similar scenarios also showed up in Ref. [5] which studied non-standard decay modes of the 
charged and heavy CP-even Higgs bosons."'" 



B. Constraints from Upsilon decays and direct searches for the CP-odd Higgs 

Constraints on a light CP-odd Higgs scenario come also from B factories and LHC data. 
These two sets of experimental results provide the strongest limits and thus we will not 
discuss other experimental constraints. 

Refs. [12] and [5] focused on a light SM-like Higgs boson belo"w LEP limits that dominantly decays to 
AA motivated by arguments of fine-tuning in the electro"weak symmetry breaking; thus the superpartner 
masses "were typically fixed to small values. In light of the Higgs boson discovery and direct constraints on 
SUSY spectrum, these choices are no longer phenomenologically viable. Ho"wever, rising the superpartner 
masses above limits and increasing stop masses and mixing that "would make the SM like Higgs boson 
sufficiently heavy does not change our discussion since these parameters do not enter in branching ratios of 
the CP-even or charged Higgs bosons. In addition, some scenarios in Ref. 5j had negligible B{h — > AA), 
dominant W^A, and a SM-likc Higgs in 125 GeV mass range. 
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At B factories a light CP-odd Higgs can be produced in Upsilon decays, T — )• A'j, 
with sizable rates in the NMSSM [29J. At present, the strongest constraints come from 
BaBar 001 EI] that sets limits on 5(T ^ A'j) with A t+t' at the level of 10"^ and 
A — !■ ^^fi^ at the level of 10^^ (these are the strongest limits, the exact exclusion limits 
depend on the mass of the CP-odd Higgs boson and are typically weaker as rriA increases). 

In addition, a CP-odd Higgs can be directly produced at the LHC in the gluon fusion 
channel |32]. This search strategy has several advantages. A possible discovery does not 
rely on searches in Higgs decays, for which the branching ratios are highly model dependent. 
Moreover, this mode does not suffer from phase space limitations of searches in Upsilon 
decays (for rriA approaching the mass of the Upsilon). In spite of the large production cross 
section, picking up the signal on huge background is a serious problem. The dominant decay 
mode, a — )• r+r^ seems to be hopeless; however searching for the subleading decay mode, 
A — is actually very promising [32] . 

Recently, searches for a light CP-odd Higgs boson were performed at the LHC using data 
sample corresponding to an integrated luminosity of 39.3 pb^^ at ATLAS [33J and 1.3fb~^ at 
CMS |3l] collected at ^/s = 7 TeV. Stronger limits come from CMS which sets upper limits 
on the production cross section times decay branching ratio a{pp A) x BR(y4 — )■ fi^fi^) 
in the range of 1.5-7.5 pb \^^. 

Both searches, T — )■ A'j with A — )■ r+r", fi'^n~, and gg ^ A ^ P-~^fJ'~, are mainly 
sensitive to the coupling of the CP-odd Higgs to down type fermions which is given by 
tan /3 cos 6*^1. They nicely complement each other. Babar limits are stronger for smaller CP- 
odd Higgs masses, however for rriA ^ 7 GeV the CMS limits take over. As a rough summary 
of the limits, for rriA up to ~ 9 GeV and for any 1 < tan /3 < 50 the product tan (3 cos 9a is 
constrained to be less than ~ 0.5 |3ll [35] . 

In summary, the scenario with dominant — )■ W^A and small B{h — )■ A A) that 
we consider in this paper occurs and is well motivated for small to medium tan /3 and 
small doublet fraction of the CP-odd Higgs. Predictions from this region of the parameter 
space for the processes discussed above comfortably satisfy (and are typically far below) the 
experimental limits which can be roughly translated into tan P cos 6 a ^ 0.5. 
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FIG. 1: Feynman diagrams for charged Higgs production in top quark decays with three leptons in 
the final state. 

III. CHARGED AND CP-ODD HIGGS BOSONS IN TOP QUARK DECAYS 

The main thrust of this paper is the investigation of the process 

pp^tt^t (bH-) t {bW-A°) -> t {b W'tr) (12) 

with one additional lepton coming from the W~ (first diagram in Fig. [T]) or from the t. In 
the latter case, the lepton originates from the produced in either t — )■ W^b (second 
diagram in Fig. [T| or t — )■ H^b — )■ W^A^b (third diagram in Fig. [T]). In this section we 
identify regions of the (m//±, tan/3, cos^ ^a) parameter space that are already excluded by 
present experimental data and the ones in which we expect a sizable signal. 



Direct searches for the process in Eq. (12) can be expressed in terms of constraints on 



the following combinations of branching ratios: 

Brr = Xx Bit bH^) X B{H^ W^*^A) x B{A rr) 



B 



X xB{t^ bH^) X B{H^ -> W^*^A) x B{A fifi) 



(13) 
(14) 



where the factor X ~ 1 takes into account the different possible production mechanisms of 
the IV-boson that produces the third lepton. It is given by ^ 

1 + B{t^ bW) + B{t bH^) X B{H^ M/(*)A) 



X 



(15) 



which reduces to X = 1 under the assumption B{H^ — )■ = 1. The explicit expres- 

sions for the top and charged Higgs widths that we use in this study are collected in the 
appendix. 



In reference to Fig. [T] the third lepton can be produced by the W coming from the charged Higgs decay 
(first term in the numerator) , from a standard t — hW decay of the upper top (second term) or from the 
t H+b W+A"b chain (third term). 
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FIG. 2: Branching ratios for t — t- H^b and various modes as functions of mj{± and tan/3 for 
fixed ruA = 8 GeV and cos^ 6a = ^■ 

We begin our analysis by showing in Figs. |2] and [3] the relevant top and charged Higgs 
branching ratios as functions of 'mjj± for fixed ttla = 8 GeV and various values of tan/3 
and cos^ 6a- Note that the mass of the CP-odd Higgs affects the kinematic threshold in the 
— > W^A decay; this channel can still be dominant below the WA threshold due to the 
off-shell — )■ W*A decay. The doublet fraction of the CP-odd Higgs impacts directly the 
H± ^ W^*^A partial width, T{H^ W^*^A) oc cos 6a, and indirectly all other channels 
(rz/ and cs) through contributions to the total charged Higgs width (in the cos^ 6a = limit 
we have 13{H^ rz/) + B{H^ cs) ~ 1). 

The most crucial ingredient in our analysis is the if^ — )■ branching ratio. Each 

contour in Fig. |4] corresponds to a different cos'^ 6a value (that label the contour itself) and 
the region to the right of each curve corresponds to B{H^ — )■ iy^*M) > 50%. The panel on 
the right zooms on low-tan (3: for tan /3 < 6 we find large regions of — )■ dominance 
even for a very small mixing angle. 



The final ingredient of our discussion is the ratio X defined in Eq. (15). The deviation 



of this ratio from 1 is controlled by the — )■ iy'^*''y4 branching ratio, and therefore by the 
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mH±(GeV) m„±(GeV) 

FIG. 3: Branching ratios of various modes as functions of cos^ 6a and mjj± for fixed ruA = 
8 GeV and tan/3 = 2. 



H-^ |^(*)A dominance dominance 
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FIG. 4: The contours correspond to a fixed value of cos^ 9a (that appears in the label) and are 
obtained imposing the BR(ff^ — )• = 50% constraint. The region of the [mj:/± , tan /3] plane 

to the right of a given contour has BR{H^ W^*^A) > 50% for any value of cos 9a than the 
indicated one. The plot on the right zooms on to the low tan /3 region. 
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FIG. 5: Ratio X defined in Eq. (15) for various values of tan P and cos OA- 



value of cos^ 9a- In Fig. [s] we show the value of this ratio for tan (3 = 1,2,5 and cos^ 9a = 
1, 0.1, 0.01. From inspection of the plot we see that for tan /3 > 2 and mH± ^ 100 GeV this 
ratio is always larger than about 95%. 

In Fig. [6]we show the allowed regions in the (m//± , tan /3) plane for cos^ 9a = 0. We include 
the constraints from direct charged Higgs searches at ALEPH |i36j, L3 ^37j, DELPHI ^38j and 
OPAL [39] (shaded gray), from -> rz/ searches at DO [lO], ATLAS p] and CMS [12] 
(shaded blue), and from H"^ — )■ cs searches at ATLAS ^3] (shaded green). The dashed 
lines are constant BR(t — > H^b) contours. The combined LEP exclusion region has been 
presented in Ref. [H] and reads mH± > 78.6 GeV at 95% confidence level. This bound 
assumes BR{H^ — > WA) = 0, nevertheless we take it as an indication of the real limit. 

If we allow a non-vanishing mixing between the singlet and doublet CP-odd Higgs bosons 
(cos^ 9 > 0) the regions excluded by the Tevatron and LHC searches gradually shrink because 
the branching ratios — > (rz/, cs) decrease as cos^ 9a increases. In Figs, [t] and [s] we 
show how these excluded regions change for non-zero values of the 9a mixing angle. For 
cos^ 9a > some portions of the (m//± , tan f3) plane are excluded by the CDF [15] search for 
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t bH+ bW+A bW+T+T- that constrains the product BR(t H+b) x BR{H+ 
ly+A) X BR(y4 —7- tt). The size of these excluded regions (shaded red) depends on cos^ 9a] a 
smaller doublet fraction implies a lower iJ^ — )• 14^'^*)^ branching ratio and therefore a lower 
experimental reach. Upsilon decay studies at BaBar and direct CP-odd Higgs searches at 



ATLAS and CMS (see the discussion at the end of Sec. II B ) roughly exclude the shaded pink 
regions. These constraints are extremely strong for large cos^ 6a but weaken rapidly with 
decreasing cos^ 6a- The area to the right of the orange contours in each plot corresponds 
to B{H^ — )■ > 50% (see also Fig. |4]) and helps visualizing the regions in which our 

search strategy is expected to be the most sensitive. The black contours in Figs. [7] and [8] 
correspond to constant Brr (the corresponding values are easily obtained by multiplying 
by iv?^/m1 ~ 3.5 x 10"^). The inner and outer thicker black contours correspond to the LHC 
expected sensitivity with 20 fb~^ at 8 TeV and 40 fb~^ at 14 TeV, respectively. A detailed 
discussion on the expected LHC reach and on the derivation of this curves is presented in 



the next section (the impatient reader can skip to Sec. IV C and Fig. 15). 

Recently CMS presented a search for new physics in multilepton events that is very 
similar in scope to the one proposed here [16]. Unfortunately the results of this experimental 
analysis do not appear to constrain the parameter space of the class of models we consider. 
Events with invariant mass of opposite-sign same-flavor (i.e. ^^^~) leptons below 12 GeV 
are rejected in order to eliminate backgrounds from charmonium and bottomonium decays. 
In addition, the isolation criterion adopted in the search removes other combinations of 
trilepton events originating from our signal. We will discuss the CMS search in more detail 
in Sec. HVCl 



IV. LHC STUDY 



In this section we discuss the LHC cross section for the signal in Eq. (12) and the cuts 
that we recommend in order to reduce the irreducible tri-lepton background. We conclude 
with a study of the signal to background ratio. 
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BR(t^H+b) 



6 - 




60 80 100 120 140 160 

m^±(GeV) 



140 160 



FIG. 6: Contours of constant BR(t — t- H^h) (labelled). Assuming cos^Oa = 0, i/ie grey region 
is excluded by direct searches at ALEPH JSS^, L3 |57|/ and DELPHI JM^. The blue region 
is excluded by — )• tu searches at DO 140}, ATLAS 141)1 and CMS \4^ - The green region are 
excluded by — )• as searches at ATLAS fJS^ . 

A. Collider signature 



Our signal can be extracted from the following distinct topologies (in parenthesis we 
specify the CP-odd Higgs decay that can lead to the final state): 



pp — )■ fi~^fi~e X {A^ — > (yUyU, rr)) 
pp —7- ji^ jjT ji X {AP —7- (/i/i, rr)) 
pp e+e"e X rr) 
pp e+e~/i X (y4° rr) 
pp^e^e^/i^X (A°^rr) 
^ /i^/i^e^ X (A° ^ rr) 



(16) 
(17) 
(18) 
(19) 
(20) 
(21) 



where e and /i indicate an electron or muon with either charge. In Eqs. (20) and (21) 



only upper or lower charges are allowed. In order to suppress the irreducible tri-lepton 



background (see the discussion in Sec. IV B) we require lepton isolation^ and, in addition, 



^ We impose isolation by requiring absence of hadronic activity in a cone Ai? < 0.4 around each lepton. 
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signal branching ratio (S„) cos 6i/i=1 



signal branching ratio {B„) cos 6^=0.5 




100 120 140 160 180 

OT^±(GeV) 
signal branching ratio {B„) cos^e^=0.1 



60 80 100 120 140 160 180 

m/f±(GeV) 
signal branching ratio (6^^) cos^e/i=0.05 




80 100 120 140 160 180 



OT^±(GeV) 



OT/f±(GeV) 



FIG. 7: Contours of constant BR{t H+b) x BR(F+ VF+A) x BR(A rr) m/ues. Contours 
corresponding to the A — )• /i^u mode are easily obtained using the m'j^/m'^ = 3.53 x 10^'^ reseating 
factor. For different values of cos^ 6a, the gray, blue and green regions have the same meaning as 
in Fig. The red regions are excluded by a direct t — t- bH^ — t- bW^A — )■ bW^T^T^ search at 



CDF 1451- The pink areas correspond to the constraints from Upsilon decays discussed in Sec. II B 



(tan P cos 9 A ^ 0.5). The region to the right of the single orange contour has BR(ff"^ — J- VF^^) > 



50%. The black dot is the point that we consider in Sec. IV. The inner and outer thicker contours 
are the LHC reach with 20 fb^^ at 8 TeV and 40 fb^^ at 14 TeV, respectively. 
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signal branching ratio iB„) cos^(9/(=0.02 signal branching ratio (B„) cos^e;(=0.01 




60 80 100 120 140 160 180 60 80 100 120 140 160 180 

OT^±(GeV) m/f±(GeV) 
signal branching ratio (B„) cos^6'^=0.005 signal branching ratio (S^^) cos^e/i=0.001 




60 80 100 120 140 160 180 




60 80 100 120 140 160 180 



FIG. 

cos^ ( 



OT^±(GeV) OT/f±(GeV) 

: See the caption in Fig. [?} For cos^ 6a < 0.01 the CDF constraint disappears. For 
< 0.005, the — t- A branching ratio is always smaUer than 50%. 



we impose the following cuts on the three highest pt leptons (£ = e, 



20 GeV highest pt lepton 



10 GeV remaining leptons 
ri{£) < 2.5 

me+e- G [0, 12] GeV , 



(22) 

(23) 
(24) 



where the choice of leptons used to calculate the invariant mass depends on the actual signal 
topology. Heavy hadron production with subsequent semileptonic or double-semileptonic 
decays is potentially a major source of irreducible trilepton background. Fortunately the 
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I highest p.^ iepton 
] 2nd highest p.^ iepton 
3rd highest p iepton 




e 

> 

U 0.8 - 



e 

O 0.7 - 



— ^fJ = 


14TeV 


— V7 = 


8TeV 


■- V7 = 


7TeV 



100 120 140 160 180 200 



(GeV) 



10 20 30 40 50 

Pt cut on the leading lepton (GeV) 



FIG. 9: Left panel: px distribution of the three highest pT leptons in the signal for y/s = 14 TeV in 
a 10^ events sample. The cut on the minimum pT of all leptons is 10 GeV. Right panel: Fraction 
of events that survive an additional cut on the highest px lepton. 

Pt spectrum of these leptons is quite soft and a pr > 20 GeV cut on the highest pt lepton 
is enough to severely suppress this kind of background leptons. We will present a through 



discussion of this source of background in Sec. |IVB[ The impact of this cut on our signal is 
quite minimal (it reduces the cross section by about 5% with respect to a flat Pt{^) > 10 GeV 
cut). In the left and right panels of Fig. [9] we show the px spectra of the three highest px 
leptons in our signal and the fraction of events that survive after increasing the cut on the 
highest Pt lepton, respectively. 

Some considerations are common to all topologies. In trilepton events with an underlying 
A ^ fifi decay we expect at least two muons in the selection which most likely are those 
produced in the A decay. In fact, leptons produced in semileptonic 6-hadron decays are 
heavily suppressed because of hadronic isolation: the probability of obtaining an isolated 
high Pt lepton from a decaying 6-hadron is about 1/200 and is much smaller than the W 
leptonic branching ratio (~ 10%). Moreover, it is possible that the second W also undergoes 
a leptonic decay and that this lepton has larger pt than one of the muons in the A decay. 
There are three sources of suppression of this possibility: the leptonic W branching ratio 
(~ 10%), the Pt cut and the di-muon invariant mass cut (remember that in this case the 
di-muon invariant mass will not typically be close to m^). Therefore, this effect is very tiny 
and will be neglected. Another feature of the A — )■ /i/i mode is that, in the three muon final 
state, the opposite sign muons that reconstruct the CP-odd Higgs are, in the majority of 
cases, the single opposite sign muon and the lowest pt same sign muon. For the benchmark 
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point we consider this selection criterion picks up 80% of the correct di-muon pairs. 

In the y4 — 7- rr case, the situation is more comphcated because the r's can decay into 
muons or electrons. We can again safely neglect simultaneous semileptonic decays of both 
W bosons because very few events would have a di-lepton invariant mass that falls in the 
[0, 12] GeV range. If both r's decay to muons, and one of the W^s decays into an electron, 
the di-muon system originates entirely from the A decay and its invariant mass is going to 
be strictly smaller than m^. The interesting possibility of having each tau decaying to a 



different lepton, allows for the same sign and same flavor topologies in Eqs. (20) and (21) 
whose background turns out to be extremely small. As in the A — )■ fifi case, the opposite 
charge leptons that come from the tau decays can be identify by selecting the lowest pt 
same sign lepton (we don't distinguish between e and /i as both can appear in tau decays). 
For the benchmark point we adopt this criterion picks up 89% of the correct di-lepton pairs. 
Let us now briefly discuss individual features of the signal topologies we consider: 

• fi^fi^e. Events coming from an underlying A — )■ fifi decay are trivially extracted by 
considering the di-muon invariant mass. The A tt channel is more complex because 
of the possibility of having the two taus decaying to different leptons: in this case the 
di-muon invariant mass will not peak at all below and these effects are tiny. In 
conclusion, if the three highest Pt leptons are fifie, we will simply plot the di-muon 
invariant mass. 

• fi~^fi^fi. In this case there is an intrinsic ambiguity in the choice of the "correct" 
di-muon pair. As explained above, by considering the lowest pt same sign muon we 
select the correct di-muon pair with a 80% probability. 

• e'^e~e and e'^e'fi. Decays with an underlying A ^fi do not sizably contribute to 
this selection. In fact, the e^e~ ^ final state could be obtained with two W decays 
to electrons; the requirement of low di-lepton invariant mass severely suppresses this 
contribution. The e^e~e final state is, instead, almost impossible to produce in A — )■ 
/i/i events. In both modes each of the light leptons can originate from a tau. By 
selecting the lowest px same sign lepton we reconstruct the correct di-lepton pair with 
a 89% probability. 

• /i^/i^e^ and e^e^/x^. These signals are produced by an underlying A ^ tt decay in 
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which the two taus decay to different ffavor leptons. The leptons originating in the 
A decay can be either of the two opposite charge combinations. Therefore, the signal 
extraction is very similar to the e~^e~e and e^e~/i cases. The main difference is that 
the background for two same-sign same-flavor leptons is severely reduced. 

Before applying any cut to the final state muons, the signal cross sections can be calculated 
exactly in terms of the parameters of the model and the tt cross section. As a benchmark 
point we take mH± = 120 GeV, tan/3 = 1.5, niA = 8 GeV, and cos^6'a = 0.1, see the black 
dot in Fig. W\ for which we have 



BR(t ^ bW) = 88.7% , 
BR{t H^W) = 11.3% , 
BR{H^ AW) = 99.3% . 

We also take the NNLL pp — > tt cross sections from Ref . HH] : 



(25) 
(26) 
(27) 



a{pp —J- ti) 



162 4+6-7+7.3 



-40+65 



for Ecu = 


7TeV 


for EcM = 


8 TeV 


for Ecu = 


14 TeV 



Using the above inputs and cross sections we obtain fi^^ 
following signal cross sections: 



(28) 



3.6 X 10'\ Err = 0.092, and the 



a{pp -> AiX fifiiX) 



4 X (t{pp ^ti) X Bf,f, X BR{W 

24.5 fb for Ecu = 7 TeV 
35.0 fb for Ecu = 8 TeV , 
135.1 fb forEcM = 14TeV 



(29) 



a{pp AeX TTiX mX) = 4 X a{pp ^ tt) x Brr x BR(r ^ iuiy)' x BR{W iu) 



(30) 



187.1 fb 


for Ecu = 


7 TeV 


267.0 fb 


for EcM = 


8 TeV 


1032.1 fb 


for EcM = 


14 TeV 
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where ^ is either e or fi. The factor of 4 comes from having two top quarks that can decay 
to H^b and two W bosons that can produce the charged lepton. In order to reduce the 



background to manageable levels, we require the cuts in Eqs. (22 24). Using SHERPA 
V. 1.4.0 |l9] - [52] . we extract the ratio of the signal cross section calculated with and without 
these cuts. We obtain the following acceptances: 



a{pp -> A£X uniX) 



cut 

SHERPA 



a{pp AiX /X/x£X)sHERPA 



a{pp AiX TTiX mX) 



0.27 forEcM 
0.27 for^cM 
0.26 for Ecu 



cut 

SHERPA 



a{pp ^ AiX ^ TTiX ^ MX)sHERPA 



= 7TeV 




= 8 TeV , 




= 14 TeV 




for EcM = 


7 TeV 


for Ecu = 


8 TeV 


for EcM = 


14 TeV 



(31) 



(32) 



The final signal cross sections that we obtain are: 



a{pp AiX fxfxiX) 



cut 



a{pp AiX -> TTiX iiiX) 



cut 



6.7fb 


for Ecu 


= 7TeV 


< 9.4 fb 


for Ecu 


= 8 TeV 


35.0 fb 

V 


for Ecu 


= 14 TeV 


6.4 fb 


for Ecu 


= 7TeV 


< 9.5 fb 


for Ecu 


= 8 TeV 


40.3 fb 


for Ecu 


= 14 TeV 



(33) 



(34) 



The signal cross section (where we include only the A — )■ /i/x channel) as a function of the 
lepton pt cut and for mA = 5,8,10 GeV is shown in the left panel of Fig. 10 and Table [1} Note 
that here we show the results we obtain imposing the same px cut on all final state leptons. 
The cuts that we actually propose {px > 20 GeV for the leading lepton and pr > 10 GeV 
for the other two) reduce the p^"* = 10 GeV case by 5% (this reduction is implemented in 



Eqs. (I3l}|34j)). 

Finally, we investigate the dependence of the signal acceptance (defined as the fraction 
of events that survive the cuts we impose) on the model parameters. The only parameter 
whose impact on the acceptance is quite relevant is the charged Higgs mass. In the right 



panel of Fig. 10 we show the dependence of the acceptance r^^ on m^i. The behavior of 

21 



the acceptance in the range 80 GeV < mH± < 100 GeV is a result of the transition between 
the on-shell — )■ W^A and the off-shell three-body — iy=^*y4 -> fifjA decays. Just 
above the threshold the momentum of the CP-odd Higgs in the charged Higgs rest-frame 
is small. Below the threshold we have an effective three body decay and the mass of the 
charged Higgs is distributed amont the final state particles. 




60 80 100 120 140 160 



i^r (GeV) mH<GeY) 

FIG. 10: Left pane: Dependence of the signal cross section on the px cut on the three leptons. 
Dotted, solid and dashed lines correspond to tua = 5, 8, 10 GeV, respectively. Right panel: 
Dependence of acceptance r^^ on the charged Higgs mass for different center-of-mass energies. 

B. Background 

We classify the background to our signal (three charged leptons, with low invariant di- 
lepton mass and relatively low px) into two main groups: 

• Electroweak. In this group the underlying hard scattering has at least one elec- 
troweak (EW) gauge boson {W, Z or 7*) in the final state. We can further divide 
these processes according to the number of leptons that originate in single and double 
semileptonic heavy hadron decays. The only process in which all three leptons orig- 
inates from EW bosons is pp — )■ WZ /'-/*, and it has a negligible contribution to our 
background (see Table |ll]) . Processes in which only one lepton is produced in heavy 
meson decays are pp — )■ {bZ, cZ, bbZ, ccZ, ti, tW) and represent the dominant 
source of EW background. Finally the processes pp — > {tb, bbW, ccW) require two 
single or one double semileptonic heavy hadron decay. 
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a{pp A£X /i;u«)™* [fb] 



rriA 


Vs 


PT >3 


PT > 4: 


Pt > 5 


> 6 


PT >7 


PT > 8 


> 9 


PT > 10 


[GeV] [TeV] 


[GeV] 


[GeV] 


[GeV] 


[GeV] 


[GeV] 


[GeV] 


[GeV] 


[GeV] 


5 


7 


18.0 


16.5 


14.9 


13.5 


12.1 


10.8 


9.6 


8.5 


5 


8 


25.4 


23.2 


21.1 


19.1 


17.1 


15.3 


13.7 


12.1 


5 


14 


92.9 


85.2 


77.5 


70.2 


63.2 


56.5 


50.6 


45.0 


8 


7 


14.1 


12.9 


11.7 


10.5 


9.5 


8.4 


7.5 


6.7 


8 


8 


19.9 


18.1 


16.5 


14.9 


13.4 


12.0 


10.6 


9.4 


8 


14 


72.6 


66.4 


60.3 


54.6 


49.2 


44.1 


39.4 


35.1 


10 


7 


13.6 


12.3 


11.2 


10.1 


9.0 


8.1 


7.2 


6.3 


10 


8 


19.1 


17.4 


15.8 


14.2 


12.8 


11.4 


10.2 


9.0 


10 


14 


69.7 


63.5 


57.7 


52.1 


46.8 


41.9 


37.5 


33.4 


r 




0.54 


0.49 


0.45 


0.40 


0.36 


0.33 


0.29 


0.26 



TABLE I: Cross sections (in fb) for pp — )• AiX — )• fx/ilX . In order to compare different pT cuts, 
we require the three charged leptons to have the same minimum pT- Our optimal selection requires 
a hard lepton with pT > 20 GeV and two softer ones with pT > 10 GeV. The last row of the table 
gives the acceptance r^^; this quantity is essentially independent of tua and y/s. 

• QCD. In this group all three leptons come from single or double semileptonic 
decays of heavy final state hadrons. The underlying processes in this case are 
p — )■ {bb, cc, bbbb, cccc, bbcc). 

Electroweak background topologies have been extensively studied in Ref. [53]. The results 
presented in the second column of Table II of Ref. |53] have been calculated for ^/s = 14 TeV. 
We use Madgraph 5.2 [SI] to calculate appropriate rescaling factors for each background and 
obtain the corresponding results at ^/s = 7 and 8 TeV. Moreover, we limit the integration 
to the mu e [0, 12] GeV range**. 

** The complete histograms of the various contributions to trilepton production at low di-lepton invariant 
mass have been kindly provided to us by Zack Sullivan. 
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The estimates in Ref. [53] combine together samples with £ = e, /i; therefore, in order 



to extract the backgrounds to the signatures in Eqs. (16-21) we have to apply appropriate 
combinatorial correction factors. We summarize our findings in Table |TlJ Here we give 
explicit cross sections for the /i"^/i~e and e~^e~fi and specify the combinatorial factors that 
have to be applied in order to get the remaining topologies. Heavy hadron production 
in which the final state b- and c-hadrons decay semileptonically have not been studied in 
Ref. [53] but are relevant in the phase space region we are interested in. The procedure we 
followed to estimate these purely hadronic backgrounds is presented below. 

Trilepton events originated by heavy fiavor production {pp — )■ bb, cc, bbbb, cccc, bbcc) 
followed by single and / or double semileptonic decays of heavy mesons are negligble at large 
dilepton invariant mass but are the dominant source of background at low pt and low 
invariant mass. The first step towards an estimate of these backgrounds is to calculate cross 
sections for these five channels with px{b,c) > 10 GeV (we use SHERPA v. 1.4.0 p9] - [52] ). 
Following Ref. [H3|, the probability of emitting an isolated lepton with pj- > 10 GeV from 
an heavy quark with px > 10 GeV is roughly obtained by multiplying the cross section for 
heavy fiavor production by a suppression factor ~ 1/200 (for each required isolated lepton). 
Finally we extract the fraction of events in the dilepton invariant mass region from a Drell- 
Yan sample and assume a degree of universality in the shape of the dilepton invariant mass 
distribution (our study finds that the fraction of events with invariant mass below 12 GeV 
is about 30%). The results we obtain indicate that these processes are the dominant source 
of background for px > 10 GeV leptons at low invariant mass. 

In order to keep these backgrounds under control we note that lepton isolation implies 
that only b- and c-hadrons with pt ^ 35 GeV have an appreciable rate for production of 
muons with px > 10 GeV (see Ref. [Mj). We take advantage of this feature by requiring an 
additional cut of 20 GeV on the highest px lepton (that, as discussed in the previous section 
and in Fig. |9| reduces the signal by about 5%). From the results in Ref. ^3] we found that 
this requirement causes an additional suppression factor (that we estimated to be 0.12). 

Finally we note that underlying hadronic processes with only two heavy hadrons {bb, cc) 
have a huge cross section of order 0(10 fib) but require double semileptonic decays of one 
heavy hadron. An appropriate convolution of the probability distributions presented in 
Ref. [S3] leads us to estimate the additional suppression associated with a double semilep- 
tonic decay at the 5% level. 
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mode 






^fi e, e~^e 


> 




'"e e 








Vs 


7 TeV 


8 TeV 


14 TeV 


7 TeV 


8 TeV 


14 TeV 


7 TeV 


8 TeV 


14 TeV 




WZ/-f 


0.7 




0.8 


2.6 




1 













bZ 


5.4 




7.0 


19.0 




1 













cZ 


1.4 




1.7 


4.7 




1 











? 


bbZ 


3.7 




4.7 


12.2 




1 













ccZ 


2.1 




2.6 


6.4 




1 













tt 


0.1 




0.1 


0.4 




1/2 






1/2 






tw 


0.01 




0.02 


0.08 




1/2 






1/2 






tb 


1.3 X 10" 


-4 


1.5 X lO"'' 


3/1 X lO-'' 




1/2 






1/2 






bbW 


1.3 X 10" 


-3 


1.5 X IQ-^ 


2.6 X IQ-^ 




1/2 






1/2 






ccW 


2.6 X 10" 


-5 


2.9 X 10-5 


5.4 X 10-5 




1/2 






1/2 






bb 


6.1 




7.1 


13.3 




1/2 






1/2 




a 


cc 


7.5 




8.8 


16.3 




1/2 






1/2 




CD 


bbbb 


0.2 




0.2 


0.6 




1/2 






1/2 






cccc 


0.5 




0.6 


1.5 




1/2 






1/2 






bbcc 


0.6 




0.7 


1.9 




1/2 






1/2 




g 


EW 


13.2 




16.9 


45.3 


13.2 


16.9 


45.1 


0.05 


0.07 


0.3 




QCD 


14.9 




17.5 


33.7 


7.4 


8.7 


16.8 


7.4 


8.7 


16.8 


O 

4^ 


EW+QCD 


28.1 




34.4 


79.0 


20.6 


25.6 


61.9 


7.5 


8.8 


17.1 



TABLE II: Background for trilepton production with lepton isolation, the pT of the three leptons 
are bigger than (20, 10, 10) GeV (pT ordered) and mu < 12 GeV. The mode label refers to the three 
different topologies we discuss in Sec. 



IV A 



: we give explicit cross sections for the £■ £fij topology 



and just present the rescaling factors one has to apply to the other modes. 



Note that the procedure outhned above leads only to a rough estimate of these back- 
grounds and should be trusted only if the resulting rates are well below our signal. In any 
case, pushing the cut on the highest pt lepton to 30 GeV would essentially eliminate these 
hadronic backgrounds at the cost of a 20% signal suppression (see Fig. [9]). 
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Our estimates for bb and cc production with prib, c) > 10 GeV are: 



C^bb 



7.3 fih 7 TeV 
8.6 fib 8 TeV 
16.2 fih 14 TeV 



9.0 /ib 7 TeV 
10.6 /ib 8 TeV 
19.6 /ib 14 TeV 



(35) 



Each process carries a suppression factor 



4x0.3x0.12x0.05 
200^ 



2.3 X 10 ^° where the factor of 4 



takes into account all possible final state leptons combinations, each 1/200 factor accounts for 
the emission of an isolated lepton, the 0.3, 0.12 and 0.05 factors account for the m« < 12 GeV 
cut, the effects of the pt > 20 GeV cut and the extra suppression due to the required 
double semileptonic decay, respectively. The results we obtain are of order 0(10 fb) and are 
presented in table [Tij 

Estimates for leptons from bbbb, cccc and bbcc with prib, c) > 10 GeV are: 



(^bbbb 



4.7 nb 7 TeV 

6.2 nb 8 TeV , (^cccc 

16.4 nb 14 TeV 



13.7 nb 7 TeV 

17.8 nb 8 TeV , (^blc 
44.3 nb 14 TeV 



16.5 nb 7 TeV 

20.8 nb 8 TeV • (36) 

53.6 nb 14 TeV 



Each process carries a suppression factor 



8x0.3x0.12 
2003 



3.6 X 10 ^ where the factor of 8 takes 



into account all possible final state leptons combinations, and the other factors have the 
same meaning as above. The results we obtain are of order few fb and are presented in 
table HI 



C. Extraction of the signal and LHC sensitivity 



In this section we combine the signal and background estimates discussed in Sees. IV A 



and IV B and extract the expected LHC sensitivity. In Figs. 11 14 we show signal and 
background for various topologies and center-of-mass energies. The benchmark point that 



we consider is given above Eq. (25), the integrated signals are presented in Eqs. (33) and 



(34) and the background is summarized in Table II 



In Fig. 11 we show the di-muon invariant mass, m^^, and separation, AR^ 



a/A</)2 + for the jj'^fi e topology and for ^/s = 7, 8 and 14 TeV. The sharp peak 
and the broad bump correspond to underlying A — )■ /x/i and A — )■ rr decays. As seen in 
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Sec. IV A the large enhancement oi A tt modes is compensated by the suppression im- 
phed by the two semileptonic r — )■ fiu^Ur decays. On top of this, the broadening of the rr 
peak due to the large amount of missing energy makes the identification of A rr modes 
rather difficult. We comment on this later in this section. 

Following the expected mass resolution of the ATLAS detector, we choose to present 
the histograms in 100 MeV bins; as seen in T — )■ fifi studies at ATLAS (see, for instance, 
Ref. [55]), this is indeed the resolution for low px and low invariant mass di-muons emit- 
ted in the central region. In this study we assume an exact 100 MeV sensitivity but will 
conservatively double the background in our estimate of the experimental sensitivity. 

In each plot we separate the total background into its EW and QCD components. As 



discussed in Sec. |IVB| the latter can be reduced further by requiring a harder cut on the 
highest pt lepton: for pr > 30 GeV we loose about 10% of the signal (see Fig. [o]) but the 
QCD background becomes essentially negligible. 

Another important feature of our signal (that is common to di-muon and di-tau events) 
is the low AR^fj^ we find between the two muons that reconstruct the CP-odd Higgs A. 
This feature is common for both signal and background and has a simple kinematical origin. 



namely high pt and low invariant mass of the lepton pair. In Fig. [TT]we separately show the 
AR^fj_ distributions for events originated from the A tt bump (blue) and from the A — )■ /i/x 
peak (magenta). We note that in the A — t- rr case the upper limit on the angular separation 
is about 0.35 at 7 TeV (and it increases to 0.45 at 14 TeV), and in the A — )■ /i/x case we 
find slightly larger separations (0.55 at 7 TeV up to 0.7 at 14 TeV). This demonstrates that 
the recent CMS search for new physics in multilepton events |16] is not sensitive to these 
scenarios because our signal events would be removed by the isolation criterion adopted in 
the search. In this CMS analysis leptons are rejected if the ratio of the total transverse 
energy (sum of track p^ and calorimeter-tower in a cone of AR < 0.3 for muons and 
AR < 0.4 for electrons) to the lepton pj- is smaller than 15%. In our case, as can be seen 



from the blue region in the top right panel in Fig. [TT| these AR cuts essentially eliminate all 
signal events. Remember that the red region corresponding to A — )■ fifi is also rejected in the 
CMS analysis because of the lower cut on the opposite-sign same-fiavor dilepton invariant 
mass. The important consequence of this observations is that only hadronic lepton isolation 
should be applied. 

Finally, let us comment on one particular search that was presented in Ref. [IB] and 
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that could possibly constrain our parameter space. CMS looked for four-lepton events (two 
hadronic taus and two light leptons) and even have a slight excess (see the 7th entry in 
Table 1 of Ref. In our class of models this exact signature is easily obtained by having 

the CP-odd Higgs decay to taus and both W bosons decay leptonically. The cross section 
associated to this process can be very large; in fact, we replace the ~ 3% suppression due 
to leptonic decays of the taus with a milder suppression from an extra leptonic W decay. 
The two (hadronic) taus are produced in a small AR < 0.35 cone and are mostly cut by the 
CMS isolation criterion. The question whether enough events survive the isolation cut at 
a level compatible with the results presented in Ref. [1B| is very interesting and a detailed 
analysis will be presented elsewhere [56]. This highlights the importance of understanding 
pairs of hadronic taus at small angular separation. The issue of isolation in this context has 
also been recently discussed in Ref. [57] . 



For convenience, in Figs. 12 -14, we show the di-lepton invariant mass and AR distribu- 



tions of the remaining signal topologies for = 7, 8 and 14 TeV. As discussed in Sec. IV A 



only the mode displays the A — )■ /i/i peak. Same sign topologies (the /x^/x^e^ and 

e^e^fi^ distributions are identical) receive background only from purely hadronic underlying 
processes. We further remind the reader that all QCD backgrounds can be further reduced 
by increasing the cut on the highest pr lepton: for the /x^/i^e^ and e^e^/z^ modes this 
opens the possibility of a nearly background free search. 

We define the 95% experimental sensitivity as the cross section required to generate (at 
a given luminosity) twice the square root of the number of background events. We focus on 
two experimental scenarios: ^/s = 8 TeV with a luminosity £ = 20 fb~^ (end-of-2012 data 
set) and ^/s = 14 TeV with a luminosity £ = 40 fb~^ (expected end-of-2015 data set). For 
these two scenarios we take the background per 100 MeV bin to be about 1 fb (that is about 



twice our estimate as can be easily seen in Figs. 11-14). 



In Fig. 15 we present the LHC reach for these two scenarios in the [mj^^i , tan /3] plane. The 
contours correspond to the experimentally accessible region for different values of cos^ 9a 
(used as label). Note that in drawing the contours we include the effects of the 
dependence of the acceptance (see Fig. 10). These contours are also plotted in Figs. [Tjand 
[8] It is clear that this search strategy allows to almost completely cover all the parameter 
space that is currently left open by present experimental results. 
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FIG. 11: di-muon invariant mass and Ai?^j^ distributions for the jjL^e topology. In the Ai?^^ 

distribution we further separate contributions originating from the A — )• rr (blue) and A — )• /i// 
(magenta). 
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FIG. 12: Di-muon invariant mass and AR^^ distributions for the fi^fi^fi topology. In the Aii^^ 

distribution we further separate contributions originating from the A — )• rr (blue) and A — )• fj,fi 
(magenta). 
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FIG. 13: Di-electron invariant mass and AR^e distributions for the e^e e topology. The e~^e fi 
topology yields identical distributions. 
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FIG. 14: m,^±gT and AR^±^^ distributions for the ^^fi^e^ topology. 



32 



95% C.L. Sensitivity Vi" = 8 TeV, L = 20 fb"^ 95% C.L Sensitivity Vi" = 1 4 TeV, L = 40 fb"'' 




80 100 120 140 160 80 100 120 140 160 



m/j±(GeV) mH<G&W) 

FIG. 15: Expected LHC sensitivity for the 2012 (V^ = 8 TeV and £ = 20 fb"^) and 2015 (Vs = 
14 TeV and £ = 40 fb^^) scenarios. The contours are labeled by the value of cos^ Oa- 

V. CONCLUSIONS 

In singlet extensions of the two Higgs doublet model, the decay mode of the charged Higgs 
boson into W and a CP-odd Higgs, — )• W^A, dominates in a large range of charged 
Higgs boson mass and tan /3 even if the light CP-odd Higgs boson is ~ 99% singlet-like. 
For larger doublet fraction of the CP-odd Higgs the branching ratio of this decay mode is 
close to 100%. Thus the usual searches for the charged Higgs boson in top quark decays, 
— > Tu and — > cs, should be expanded to account for this possibility. 

We study this scenario assuming couplings of Higgs bosons to fermions, gauge bosons, and 
other Higgses according to the two Higgs doublet model Type II. The two CP-odd Higgses 
originating from doublets and the singlet can mix, and thus the light CP-odd Higgs is allowed 
to have an arbitrary doublet fraction. A light CP-odd Higgs boson can be motivated by 
approximate global symmetries and thus it occurs in a variety of models. A large singlet 
fraction is sufficient not to significantly modify the decay modes of the SM-like Higgs boson. 
It also easily allows the CP-odd Higgs to avoid detection in Upsilon decays or in direct 
searches, which roughly translate into limit the tan /3 cos < 0.5. Thus this scenario is 
relevant the most for small to medium tan /3. 

In the three dimensional parameter space, mH±, tan /3, and cos^ 6a, we summarize exper- 
imental constraints from direct searches for — > rz/, — > cs, and — )■ W^A followed 
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by y4 — )■ r+r", map out the region where H"^ — )■ W^A dominates, and calculate the LHC 
reach of the search based on A — > r+r^ (with both rs decaying into leptons) and A — t- fj^^fi''. 
This search is especially advantageous if the CP-odd Higgs is below the bb threshold, that 
we assume, but it is also applicable to heavier CP-odd Higgses. 

To suppress background, especially from semileptonic bottom and charm decays, we 
require an additional lepton (e or /i) from one of the two Ws. In addition to the A — )■ fi~^fi~ 
case, in which the mass of the CP-odd Higgs can be reconstructed, there is a complementary 
signal when e and /i leptons originate from A — )■ r+r~. In the special case in which we have 
two same sign same flavor leptons, e.g. fi~^fi^e~, the background is very low. We find that 
this search in 20 fb^^ of data from the 8 TeV run of the LHC can constrain a large region of 
the parameter space to which other searches are not sensitive. We also discussed the reach 
of the LHC with 40 fb~^ of data at 14 TeV center-of-mass energy. These are summarized in 
Figs. [7] and [8] by black thick lines, or in a different way in Fig. 15 



We showed that existing trilepton searches are not sensitive to our signal because the 
adopted isolation criterion effectively removes high pt muons (electrons) with AR < 0.3 



(0.4) and, as can be seen in Figs. 11 14, this essentially eliminates all our signal events. 
This shows the limitations of general trilepton searches and highlights the importance of 
dedicated searches that would pick up events with di-leptons (e, /i, hadronic r) at small 
angular separation. 

The analysis strategy presented in this work can be further improved with the addition of 
b-tagging. Since the signal contains two b-jets, requiring b-tagging would not significantly 
reduce it while the background, especially that from semileptonic bottom and charm decays 
would be highly suppressed. Moreover, there are interesting signal topologies that we have 
not considered in detail. For example, the scenario we consider can also lead to a sizable 
excess of four lepton events with two hadronic taus and two light leptons in which the two 
taus are very close to each other. This again stresses the importance of understanding pairs 
of leptons at small AR. 
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Appendix A: Partial Widths 



In this appendix we collect the expressions for various partial widths of the top quark, 
CP-odd and charged Higgs bosons. The two dominant partial widths of the top quark are: 

(Al) 
(A2) 



Tit ^ hW^) = -^^f^ (1 - xwtf (1 + 2 xwt) 

V2 OTT 



V2 Stt 



tan^ (5 + 



v 



tan2/3 



where xwt = "^w'Mt.poie; ^Ht = "^^i /"^i ,poie f^t = 0{mt). 
The three largest partial widths of the CP-odd Higgs are: 



T{A ^ /iV) 
T{A^ cc) 



V2 47r 
Gp tua 

Gp ITT-A 



a/I — 4:XrA ^^^^ "^OS^ 9 A , 

\/l — 4:X^A m-fi tan^ /3 cos^ 6a 

-| 2 



COS 6'^ 



(A3) 
(A4) 

(A5) 



where x-ta = ml/m\, x^a = ml/m\, XcA = ml,poie/^\ and /ia = 0{mA). 

For a charged Higgs lighter than the top quark, the allowed on-shell two body decays 
are pHBO]: 

Gp mH± 



I- (1 — Xt-^h-)^ tan^ /3 , 
V2 47r 



(A6) 



1 2 



tan^ /3 



+ 



Gp mf^± 



tan^ /3 



3/2 



(A7) 
(A8) 



where XrH = m^/m^i, = mlp^iJmj^^, fin = 0{niH±), Xwh = m}y/m]j± and xah = 
m^/m^j^. The factor Agg encapsulates QCD corrections and its approximate form is [6TH63] 

A,, 5.67 ^-^^^"^ + (35.94 - l.^m^)'^^ 



(A9) 
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It is also important to include decays mediated by a virtual top or W. In the scenario that 
we discuss in this paper (m/^± < rrit), the top in the — > t*b — > W^bb mode is always off 
mass-shell. In this limit the phase space integration can be easily done analytically and, in 
the limit in which we neglect the m^/m^ ratio, one obtains 

- n 4 



-mH± 



X 



647r3 tan^ /3 

{4:XwH XtH + ^XtH - ^Xwh) \0g[xwH{XtH " / {XtH " ^wh)] 



tH 



+ {SX^H - 4:XtH - 3x^j^ + 1) log[{xtH - l)/{XtH " xwh)] - 5/2 
+ (1 - xwH)/XiHi3x'ifj - ktxwH - 2xtHXwH + ^^wh) + xwHi4: - 3/2xwh) 

(AlO) 

where Xwh = rn^/m^^ and Xtn = [mf^'^{^iH)f 

Finally, we turn to the off-shell contributions to the — )■ A mode presented in 



Eq. (A8). In the parameter space region that we consider {mH± < mt and niA < rrir) 
the H+ W^*^A decay can proceed through a real or virtual W, and we need the exact 
integration over the Dalitz plot phase space in order to capture both effects. The doubly 
differential rate is EO] 



-^j^^^r^ = cos Ua ^g^3 mH± Faw{XuX2) . (All) 

The function Faw{xi,X2) is given by 

7^ f \ {1 - Xi){l - X2) - XAH ..^^x 

Faw{xi,X2) = Y2 ' (A12) 

^ Xwh + (1 - xah + Xwh - Xi - X2Y 

where xah = "^i/^^^^i, ^w is the total width of the W ^ Xi = 2Ei/mH± are the normalized 
energies of decay products of the W , and the integration range is: 

Q<X2<l-XwH ^ (A13) 

l-X2-xwH<x^<l- . (A14) 

I-X2 



Note that there is a typo in Eq. (59) of Ref. [20] 
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Note that for an on-shell W, the integral over Eq. (All) reproduces the standard two body 
decay given in Eq. (A8). 
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